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(54) Vehicle monitoring apparatus 

(57) A vehicle monitoring apparatus for obtaining a 
distance image including an image data and three-di- 
mensional distance information and for monitoring sur- 
rounding conditions on the basis of the distance image, 
comprises: means for dividing the distance image into 
a plurality of blocks composed of picture elements, 
means for collecting the blocks having a similar distance 
data and for grouping the blocks into an independent 
group, means for calculating an area size of the inde- 
pendent group, means for extracting the image data as 
an object data if the area size of the group is larger than 



a predetermined value and for discarding the Image da- 
ta as a false data if the area size is smaller than the 
predetermined value, means for preparing a histogram 
having a lateral axis representing a deviation amount 
and a longitudinal axis representing a frequency corre- 
sponding to a number of the image data, and means for 
detecting an object and a distance to the object by de- 
leting the frequency having a smaller number of the im- 
age data than a threshold value along the lateral axis 
on the histogram. Thereby, false data can be removed 
from the image data and a mismatching can be prevent- 
ed. 
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Description 

The present invention is related to a monitoring ap- 
paratus for a vehicle for recognizing road and traffic con- 
ditions around the vehicle based on distance images. 

With increased numbers of vehicles and with in- 
creased numbers of traffic accidents, the conception of 
Advanced Safety Vehicle (ASV)is becoming one of the 
primary strategies in designing a vehicle. In particular, 
ASV raises the intelligence level of a vehicle through the 
state of the art electronic technologies. In recent years, 
various safety devices such as issuing an alarm to in- 
form a vehicle driver of a likelihood of collision, stopping 
a vehicle, decreasing or increasing the speed of the ve- 
hicle by detecting a vehicle travelling ahead or an ob- 
stacle through a television camera, a laser-beam radar 
or the like, have been proposed. 

The inventor of the present invention, in Japanese 
Patent Application Laid-open No. Toku-Kai-Hei 
5-26554, discloses a technique in which pictures taken 
by two stereoscopic cameras are converted into dis- 
tance Images, these distance Images are divided into 
lattice-like small regions at an interval of 8 to 20 picture 
elements and solid objects are detected for each small 
region. 

This prior art is primarily intended to be used for de- 
tecting obstacles in highways or roads for motoring and 
therefore the roughness of pictures like this, i.e., 8 to 20 
picture elements per small region, is at a permissible 
level because the size of obstacles can be considered 
to be relatively large. 

However, when the subject vehicle travels on nar- 
row or crowded roads, in order to judge a possibility of 
collision or contact with an obstacle lying on the road 
with high precision, it is necessary to detect a correct 
position of the obstacle and its more detailed configura- 
tion such as an unevenness of the surface of the object 
or protuberances or indents of the obstacle as well. To 
cope with a situatksn like this, the distance image must 
be divided at a finer interval than 8 to 20 picture ele- 
ments. On the other hand, such a rough Interval as 8 to 
20 picture elements tends to incur erroneous detections 
due to noises included in the image. 

It is therefore an object of the present invention to 
provide a vehicle monitoring apparatus capable of ob- 
taining more precise and more reliable surrounding in- 
formation which is free from noises. To achieve the ob- 
ject, the vehkile monitoring apparatus for obtaining a 
distance image including an image data and a three-di- 
mensional distance information and for monitoring sur- 
rounding conditions on the basis of the distance image, 
comprises: 

means for dividing the distance image into a plural- 
ity of blocks composed of at least one picture ele- 
ment; 

means for collecting the blocks having a similar dis- 
tance data and for grouping the blocks into an inde- 



pendent group if the blocks include image data; 
means for calculating an area size of the independ- 
ent group; 

means for extracting the image data as an object 
s data if the area size of the group is larger than a 
predetermined value and for discarding the image 
data as a false data if the area size is smaller than 
the predetermined value; 

means for preparing a histogram having a lateral 
10 axis representing a deviation amount and a longitu- 
dinal axis representing a frequency corresponding 
to a number of the image data; and 
means for detecting an object and a distance to the 
object by deleting the frequency having a smaller 
1^ number of the image data than a threshold value 
along the lateral axis on the histogram. 

By way of example only, a specific embodiment of 
the present invention will now be described, with refer- 
20 ence to the accompanying drawings, in which: - 

Fig. 1 is a schematic diagram of a vehicle rrK>nltor- 
Ing apparatus according to the present invention; 
Fig. 2 is a block diagram of a vehicle monitoring ap- 
2S paratus according to the present invention; 

Fig. 3 is a functional block diagram showing a proc- 
ess of a distance detection; 
Fig. 4 is a flowchart showing a process of a distance 
detection; 

30 Fig. 5 is a flowchart continued from a flowchart of 
Fig. 4; 

Fig. 6 is a drawing showing an example of an image 
taken by an on-board camera; 
Fig. 7 is a drawing showing an example of a dis- 
3S tance image; 

Fig. 8 is an explanatory view of a group number 
memory; 

Fig. 9 is an explanatory view of a group area mem- 
ory; 

40 Fig. 10 is an explanatory view showing a block and 
neighbouring blocks of the distance irmge; 
Fig. 11 is an explanatory view showing divisions of 
the distance image; 

Fig. 12 is a view showing an example of road sltu- 
45 ations; 

Fig. 1 3 is an explanatory view showing a relation- 
ship between a histogram and objects; and 
Fig. 14 is an explanatory view showing a result of 
detection of the position of objects. 

so 

Referring now to Fig. 1 , reference numeral 1 de- 
notes a vehicle on which a vehicle monitoring apparatus 
2 is mounted for imaging objects within a visible scope 
ahead of the vehicle and recognizing the objects for 
55 nrtonitoring. The vehicle monitoring apparatus 2 com- 
prises a stereoscopic optical system 10 tor imaging ob- 
jects from two different positions, an image processor 
20 for processing images of these objects and obtaining 
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three-dimensional distance distribution information and 
an innage processing computer 30 for detecting the con- 
figuration and position of the objects solidly based on 
thus obtained distance distribution information and judg- 
ing whether or not the objects are obstacles to raise 
alarms. 

The image processing computer 30 is connected 
with sensors such as a vehicle speed sensor 4. a steer- 
ing angle sensor 5 and the like to detect a present trav- 
elling condition of the vehicle and also connected with 
a display 9 provided at the front of a vehicle driver to 
inform of hazards. Further, it is possible to connect with 
an interface for controlling actuators (not shown) so as 
to avoid a collision with obstacles or a vehicle travelling 
ahead. 

The stereoscopic optical system 10 is composed of 
a pair of left and right CCD (Charge Coupled Device) 
cameras 10a, 1 0b. A pair of stereoscopic pictures taken 
by the CCD cameras 10a, 10b are processed in the im- 
age processor 20 according to a principle of triangula* 
tion to obtain three-dimensional distance distribution 
over an entire image. 

The image processing computer 30 reads the dis- 
tance distribution information from the image processor 
20 to detect three-dimensional positions with respect to 
the configuration of roads and solid objects such as ve- 
hicles and obstacles at high speed and judges a possi- 
bility of collision or contact with these detected objects 
based on the travelling condition detected by the vehicle 
speed sensor 4 and the steering angle sensor 5 of the 
self vehicle to inform the vehicle driver of the result of 
the judgment through the display 9. 

Fig. 2 shows a constitution of the image processor 
20 andjhe image processing computer 30. The image 
processor 20 comprises a distance detecting circuit 20a 
for producing distance distribution information and a dis- 
tance image memory 20b for memorizing this distance 
distribution information. The distance detecting circuit 
20a calculates a distance to a given object by selecting 
a small region imaging an identical portion of the object 
from the left and right stereoscopic pictures taken by the 
CCD cameras 10a, 10b, respectively and then obtaining 
a deviation between these small regions and outputs in 
the form of three-dimensional distance distribution infor- 
mation. 

Fig. 6 shows an example of either of images taken 
by the left and right CCD cameras 10a. 10b. When this 
image is processed by the distance detecting circuit 
20a, the distance distribution information outputted from 
the distance detecting circuit 20a is expressed as a dis- 
tance image (ike picture as shown in Fig. 7. 

The example of the picture shown in Fig. 7 has a 
picture size composed of 600 (laterally) x 200 (longitu- 
dinally) picture elements. Dotted portions show ele- 
ments having a large difference In brightness in the pic- 
ture shown in Fig. 6. Further, in this example, the dis- 
tance detecting circuit 20a treats the distance Image as 
an Image composed of 1 50 (laterally) x 50 (longitudinal- 



ly) blocks, I.e., 4x4 picture elements for one block or 
one small region. The calculation of distance or the cal- 
culation of the deviation amount is performed for each 
block of the left and right images. 

S The image processing computer 30 comprises a mi- 

croprocessor 30a primarily for detecting roads and the 
like, a microprocessor 30b primarily for detecting solid 
objects based on the configuration of a road detected 
and a microprocessor 30c primarily for identifying a pre- 

10 ceding vehicle or an obstacle based on the positional 
infOHDation of the detected solid objects and for judging 
a possibility of collision or contact with the preceding ve- 
hicle or the obstacle and these microprocessors 30a. 
30b, 30c are connected in parallel with each other 

IS through a system bus 31 . 

The system bus 31 is connected with an interface 
circuit 32 to which the distance image is inputted from 
the distance image memory 20b, a ROM 33 for storing 
the control program, a RAM for memorizing miscellane- 

20 ous parameters produced during calculations, an output 
memory 35 for memorizing the result of processing, a 
display controller 36 for controlling the display 9 and an 
I/O interface circuit 37 to which signals are Inputted from 
the vehicle speed sensor 4 and the steering angle sen- 

25 sor 5. 

As shown in Fig. 7, the distance image has a coor- 
dinate system composed of a lateral axis i, a longitudinal 
axis j and a vertical axis dp with an origin of the coordi- 
nates placed at the bottom left comer of the distance 

30 image. The vertical axis dp Indicates a distance to an 
object which corresponds to the deviation amount be- 
tween blocks. Therefore, in the image processing com- 
puter 30, a point (I. j, dp) on the distance image Is trans- 
formed into a coordinate system provided in the real 

35 space to perform processes such as recognition of the 
road configuration, detection of the position of solid ob- 
jects and the like. 

That is to say, setting X axis on the right side with 
respect to the travelling direction of a vehicle (vehicle 

40 1 ), Y axis in the upward directbn of the vehicle 1 and Z. 
axis In the forward direction of the vehicle and placing 
an origin of the coordinates on the road surface under- 
neath the centre of two CCD cameras 10a. 10b, X-Z 
plane (Y = 0) coincides with the road surface, if the road 

45 is flat. Accordingly, the point (i, j. dp) on the distance 
Image can be transformed into a point (x. y, z) In the real 
space as follows: 

5^ x = CD/2 + z.PW.(i-IV) (1) 



y = CH4.z.PW.(l-JV) (2) 

z=KS/dp (3) 
where CD is an inten^al between CCD cameras 10a. 
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10b; PW is an angle of visibility per picture element; CH 
is a height of CCD cameras when measured from the 
road surface; IV, JV are coordinates of an infinite point 
directly in front of the vehicle 1 on the image; and KS is 
a distance coefficient (KS = CD / PW). 

Rewriting the above equations (1)» (2) and (3) as 
follows: 

i = (X -CD / 2) / (2 . PW) + IV (4) 



j = (y-CH)/(z.PW) + JV (5) 



dp = KS/z (6) 

Next, processes in the image processing computer 
30 will be described. 

In the microprocessor 30a, first, actual lane markers 
of a road are extracted from three-dimensional position- 
al information contained in the distance image which is 
stored in the distance image memory 20b and then the 
configuration of the road is recognized by modifying pa- 
rameters of a built-in road model so as to agree with the 
actual road configuration. 

The road configuration is expressed by a plurality 
of three-dimensional linear equations. That is, the im- 
aged left and right lane markers of the road on which 
the subject vehicle is travelling are divided into a plural- 
ity of intervals determined according to distance and the 
road model Is formed by a plurality of broken lines each 
of which is expressed for every interval in the following 
three-dimensional linear equations: 

X = a • z + b (7) 



y = c • z + d (8) 

where a, b are parameters of a linear equation extended 
in the horizontal direction in the coordinate system of 
the real space and c, d are parameters of a linear equa- 
tion extended in the vertical direction in the coordinate 
system of the real space. 

In the microprocessor 30b. first, data above the 
road surface are selected from the distance inrrage 
based on the road configuration which has been detect- 
ed by the microprocessor 30a and data of solid objects 
are extracted after removing noises included in the dis- 
tance image by means of a group filter process which 
will be described rrK>re in detail hereinafter. Further, the 
distance image is divided into lattices at a specified in- 
terval and a histogram is formed for every lattice. The 
distance to a solid object is calculated based on thus 
formed histogram. Further, based on the distancie data 
of solid object, a profile of the solid object is extracted 



to identify the kind of object based on the configuration, 
size and position of the object. 

Fig. 3 shows a function of the distance detection of 
solid objects in the microprocessor 30b. As shown, the 

5 microprocessor 30b comprises a group filter processing 
section 40, an object data extracting section 41 and an 
object distance detecting section 42. In the group filter 
processing section 40, the distance image is divided into 
groups having approximately the same deviation 

10 amount by means of a group filter described below and 
in the object data extracting section 41 , picture elements 
located at higher positions than the road surface and 
having a larger group area (namely, number of picture 
elements, more specifically number of blocks belonging 

IS to the same group) than a threshold value are extracted 
as solid object data. Further, in the object distance de- 
tecting section 42, the distance image is divided in the 
lateral direction at a specified Interval and a histogram 
is prepared for each division. If there is a position show- 

20 ing a frequency larger than a threshold value in the his- 
togram, that position is a distance of the solk:! object sit- 
uated in the division. 

The group filter is of a software filter for removing 
noises included in the distance image by detecting 

2S groups having similar deviatk>n amounts from among 
nearby groups. In detecting the groups having similar 
deviation amounts, a given block Is compared with four 
adjacent (top, bottom, left and right) blocks and if the 
difference of the deviation amount is within 1 picture el- 

30 ement, the block is put into the same group. Thus, when 
a group is completed, the group is denoted by a group 
number and the group number is registered into a group 
number menrK>ry. Further, the area size of the group is 
calculated and stored in a group area memory. 

3S Generally, if an object is recognized properly, the 
deviation amount shows a tendency to change continu- 
ously in the image. That is. if a mismatching (erroneous- 
ly recognizing as the same object) occurs, the deviation 
aniount of the group tends to differ substantially from 

40 that of nearby groups. The group filter selects only 
groups having large area sizes, neglecting small area 
sizes so as to reduce adverse effects of the mismatch- 
ing. 

The group number memory, as shown in Fig. 8, is 
45 prepared so as to agree with the number of the distance 
images and its respective addresses store a group 
number belonging to the corresponding group of dis- 
tance image. The group area memory, as shown in Fig. 
9, is prepared so as to agree with the group number and 
so its respective addresses memorize a number of blocks 
(area sizes) belonging to the corresponding group. 

On the other hand, in the microprocessor 30c, other 
vehicles or obstacles existing on the adjacent left and 
right lanes are extracted, a possibility of collision or con- 
ss tact therewith is judged from the position and size of 
those vehicles or obstacles and their relative speeds 
with respect to the subject vehicle and the result of the 
judgment is displayed on the display 9. 
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Unexamined Japanese Patent Applications No. 
Toku-Kal-Hei 5-265547 and Toku-Kai-Hei 6-266828 
which are proposed by the inventor of the present in- 
vention describe in detail the afore nnentioned process 
of forming distance image, that of detecting road con- 
figuration based on the distance image, that of extract- 
ing profiles of objects and that of judging a possibility of 
collision or contact with the detected objects. 

Next, a process for the distance detection In the mi- 
croprocessor 30b will be described according to flow- 
charts of Fig. 4 and Fig. 5. 

First at a step S101 , distance data of the first block 
and at the next step S1 02. distance data of the adjacent 
blocks are read respectively and at a step S1 03 a group 
is determined. The order of determination of the group 
is: starting from the far bottom left block and proceeding 
In the right direction. When the process reaches a far 
right block, returning to a far left block above the far bot- 
tom left one and again proceeding in the right direction. 

The order of the group determination will be de- 
scribed below more specifically. Fig. 10 shows an ex- 
ample of a block "A" neighbouring with blocks "B", "C", 
-D" and "E". In this case, the blocks "B" and "C" are as- 
sumed to have been processed and their belonging 
group Is assumed to have been determined. The be- 
longing group of blocks 'E" and "D" are not yet deter- 
mined. Where Dpa is the deviatksn amount of the block 
"A" and Dpb, Dpc, Dpd and Dpe are deviation amounts 
of the blocks "B", "C", "D" and "E', respectively, the 
group determination of the block "A" is performed as fol- 
lows: 

When the deviation amount of the block "A" Is com- 
pared with the neighbouring blocks, "B". "C. "D" and 
"E". following six cases are logically considered: 

Case 1 . Dpa = Dpb and Dpa = Dpc 

Case 2. Dpa = Dpb and Dpa ^ Dpc 

Case 3. Dpa ^ Dpb and Dpa = Dpc 

Case 4. Dpa ^ Dpb and Dpa ^ Dpc and Dpa = Dpd 

Case 5. Dpa ^ Dpb and Dpa ^ Dpc and Dpa ^ Dpd 
and Dpa = Dpe 

Case 6. Dpa Dpb and Dpa ^ Dpc and Dpa ^ Dpd 
and Dpa ^ Dpe 

where the symbol "= " means that the deviation amount 
of the block "A" agrees with that of a neighbouring block 
and the symbol V " means that the deviation amount of 
the block "A" disagrees with that of a neighbouring 
block. 

The treatment of the block "A' is as foltows: 
Case 1 ; This case is divided into two cases. 



When the block 'C does not belong to the same 
group as the block "B", the blocks "A" and *C" are put 
into the group of the block "B" and when the block "C" 
bek>ngs to the same group as the block "B", the blocks 
5 "A" is put into the group of the btock "B". 

Case 2; Uncondrtranally, the block "A" is put into the 
group of the block "B" 

^0 Case 3; Unconditionally, the block "A" is put into the 
group of the block "C" . 

Case 4; The block "A" is put into a new group. 

^5 Case 5; The block "A" is put into a new group. 

Case 6; The block "A" is put Into a group "0" (isolat- 
ed). 

20 That is to say, when the block "A" is close in distance 
to a "below" or "left" block whose group number is 
known, the block "A" is classified into the same group 
as the "below" or "left" block and when the block "A" is 
not close in distance to a block whose group number is 

25 known and is close in distance to a "right" or "above" 
block whose group number is unknown, the block "A" is 
classified Into a new group having a possibility of grow- 
ing. Further, when neither of the adjacent blocks is close 
to the block "A", i.e., the block "A" is isolated, the block 

30 "A" is treated as belonging to a group "0". 

Thus, at a step S103, when the belonging group of 
a block Is determined, a group number is written onto a 
corresponding address of the group number memory 
and the program proceeds to step S104. At the step 

^ S1 04, the group area of a corresponding address of the 
group area memory is updated. Further, the program 
steps from the step SI 04 to a step SI 05 where it is 
checked whether the currently processing block is a final 
block or not. If the currently processing block is not a 

40 final block, the program returns to the step S1 02 and the 
same processes are repeated hereinafter. If the process 
reaches a final block, the program goes to a step 8107. 

For example, in case where it Is concluded that the 
blocks "A" and "C" are classified into the group of the 

45 block "B" according to the aforementioned logic, the 
group number of the block "B" is written onto an address 
corresponding to the block "A" of the group number 
memory and at the same time the group number mem- 
orized in the address corresponding to the btock "C" is 

50 updated to the group number of the block "B". Further, 
the group area memorized in the address corresponding 
to the group number which has belonged to the block 
"C" of the group area memory is reduced by 1 and the 
group area size memorized in the address correspond- 

55 ing to the group number which has been betonged to 
the bk>ck "B" is Increased by 2. On the other hand. In 
the case where It Is concluded that the block "A" Is clas- 
sified into a new group, the group number of the new 
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group is denoted by a number added to the present 
group number by 1 . 

Next, the program goes from the step S1 05 to a step 
SI 07 where the road configuration parameters are read. 
Then, at a step S108 a coordinate (i, j, dp) of the first 
picture element is read and the program goes to a step 
S109 where a coordinate (x, y, z) showing a three-di- 
mensional position of an object is obtained from the 
aforementioned equations (1 ). (2) and (3). 

Then, the program goes to a step S1 1 0 in which the 
height yr of the road surface at the distance z is calcu- 
lated using the aforesaid linear equations (7), (8) pre- 
senting the road configuration. After that, the program 
goes to a step S11 in which it is investigated whether or 
not the data of the object is above the road surface 
based on the height H calculated by the following for- 
mula (9) of the object. When It is judged that the data of 
the object is below the road surface, the program returns 
to the step S109 through a step S116 and the same 
steps are repeated hereinafter. At the step S116, a co- 
ordinate of the next picture element Is read. 

H = y-yr (9) 

tnthlscase, ifthe height H of an object is 0.1 meters 
or smaller, since the object of this size is supposed to 
be a lane marker, a stain or a shadow on the road, the 
data of the object are discarded, Similarly, since the ob- 
ject which is located at a position higher than the vehicle 
is supposed to be a bridge or a signpost, that object is 
discarded. Thus, only the data of objects which are es- 
timated to be solid objects on the road are selected. 

Next, the program goes from the step S11 1 to a step 
S112 (shown in Fig. 5) where the following processes 
are executed: obtaining a coordinate (i, j, dp) of a block, 
obtaining a group number Gn of the belonging group of 
the block by looking-up the group number memory, ob- 
taining a group area size Ga of the group by referring to 
the group memory based on this group number Gn and 
reading the group area size Ga. 

Further, at a step S11 3 it is checked whether or not 
the group area size Ga is larger than a predetermined 
threshold value (for example, 4 to 10 blocks), if it is larg- 
er than the threshold value, it is judged that the picture 
elements are data of a solid object and the program 
goes to a step 8114. If it is smaller than the threshokj 
value, the picture elements are regarded as false data 
which might have been produced by noises or the like 
and these data are discarded. Then, the program re- 
turns to SI 09 through S116. 

At the step S114, the histogram of the subject divi- 
sion is updated by the picture elements extracted as the 
data of the solid object and then at a step S115 it Is 
checked whether or not the process reaches the final 
picture element. If the process has not yet reached the 
final picture element, the program goes back to the step 
S116 where a coordinate of the next picture element is 



4 331 A2 10 

read and returns to the step SI 09 for continuing similar 

processes. 

The histogram is prepared as follows: 

As shown in Fig. 11. the distance image is divided 

5 Into a plurality of lattices each of which has a width of 
one block, i.e., an interval of four picture elements and 
the histogram is prepared for each division (lattice). That 
is, the coordinates of the histogram are composed of a 
frequency in the tongitudinal direction and a number of 

10 deviation amount in the lateral direction. The frequency 
indicates a number of data of the object data for devia- 
tion amount within a division. Further, the number of de- 
viation amount indicates a distance to the object. Fig. 
1 3 shows an example of the histogram for a picture as 

IS illustrated in Fig. 12. 

When it is judged at the step 8115 that the process 
reaches a final pk^ture element, the program goes to a 
step S1 17 where data of the histogram of the first divi- 
sion are read. At the next step S1 1 8, when the frequency 

20 of this histogram exceeds a threshold value, a deviation 
amount at this moment is detected and at a step S1 19 
the distance to the object is calculated from this devia- 
tion amount according to the aforementioned equation 
(3). 

2S That is, the histogram of a given divisk>n is investi- 
gated as follows: 

The histogram is started to be surveyed from the 
larger deviation amount towards the smaller deviation 
amount. When the frequency data exceeds a threshold 

30 value for the first time, the deviation amount of this mo- 
ment and the distance cateulated from the deviation 
amount is detected as a first distance (Z1) in this divi- 
ston. The survey of the histogram continues and when 
the frequency data exceeds again the threshold value 

35 after the frequency goes down below the threshold val- 
ue, the calculated distance is detected as a second dis- 
tance (Z2). Further, the survey continues and a third and 
fourth distances are detected. 

It should be noted that in this histogram, the number 

40 of data is almost zero where there Is no object, since 
most false data are deleted by the group filter. Thus, the 
relationship between the distribution of data and the ex- 
istence or nonexistence of an object is visualized and 
one histogram can tell that the a plurality of objects exist 

45 in a given direction. For example, as shown in Fig. 12, 
it is possible to detect a pedestrian, a forward vehicle 
and a person rkling a bike simultaneously. Under the 
condition illustrated in Fig. 12, the priorart can not detect 
a plurality of objects simultaneously, because only the 

so forward vehicle that shows a maximum frequency in the 
histogram is detected and other objects are neglected. 

Further, since most false data have been deleted 
from the histogram, the threshold value for distinguish- 
ing between the false data and the real data (real ob- 

55 jects) can be established to be smaller than that of the 
prior art and as a result it is possible to detect objects 
of small size, objects which are difficult to be imaged 
under such adverse conditions as night and the like or 
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objects whose distance data are insufficient. 

When the distances for all solid objects are finished 
to be detected within one division, the program pro- 
ceeds from the step S1 19 to a step SI 20 where these 
distances are written onto the memory and at a step 5 
SI 21 it is checked whether or not the process reaches 
the last drviston. If the process has not reached the last 
division, the program goes to the step S1 22 where the 
histogram data of the next division are read and returns 
to the step S11B. When it is judged at the step SI 21 that io 
the process has reached the last division, the program 
is finished. 

According to the present invention, since the divi- 
sion of the distance image has almost no false data, its 
width can be made substantially smaller (theoretically. ^5 
up to the width of one picture element)than that of the 
prior art and as a result the three-dimensional positional 
resolution of the detected object can be enhanced, 
thereby an unevenness. protuberances or indents of the 
object surface can be detected. 20 

The result of the aforesaid processes is shown in 
Fig. 14. This drawing is a top view showing on an X - Z 
plane the detected images of a pedestrian, a plantation, 
a fonward vehicle, a person on the bike, a wall and the 
like as shown In Fig. 1 4. 2s 

In summary, as described hereinbefore, the vehicle 
observation apparatus according to the present inven- 
tion can have a high three-dimensional resolution due 
to a thinner division of the distance image than that of 
the conventional arts in preparing the histogram for de- 30 
tecting objects, thereby detailed configurations of ob- 
jects can be detected. 

Further, since most of false data are deleted from 
the histogram data by the group filter, the existence of 
objects can be known from the histogram more accu- 35 
ratety and as a result the positions of a plurality of ob- 
jects can be detected simultaneously in the forward di- 
rection. Further, since the threshold value for discrimi- 
nating between the false data and the real data can be 
lowered, small objects or obscure objects can be detect- 40 
ed, thereby more sophisticated, more precise and more 
reliable surrounding infomiation can be obtained. 

While the presently preferred embodiment of the 
present invention has been shown and described, it is 
to be understood that this disclosure is for the purpose 45 
of illustration and that various changes and modifica- 
tions may be made without departing from the scope of 
the invention. 



Claims 

1. A vehicle monitoring apparatus for obtaining a dis- 
tance image including an image data and a three- 
dimensional distance infomiation and for monitor- ss 
ing sun-ounding conditions on the basis of said dis- 
tance image, comprising: 



means for dividing said distance image into a 
plurality of blocks composed of at least one pic- 
ture element; 

means for collecting said blocks having a sim- 
ilar distance data and for grouping said blocks 
into an independent group if said blocks include 
image data; 

means for calculating an area size of said inde- 
pendent group; 

means for extracting said image data as an ob- 
ject data if said area size of said group is larger 
than a predetermined value and for discarding 
said image data as a false data if said area size 
is smaller than said predetermined value; 
means for preparing a histogram having a lat- 
eral axis representing a deviation amount and 
a longitudinal axis representing a frequency 
corresponding to a number of said image data; 
and 

means for detecting an object and a distance 
to said object by deleting said frequency having 
a smaller number of said image data than a 
threshold value aking said lateral axis on said 
histogram. 

2. A vehicle monitoring apparatus as claimed in claim 
1 , wherein 

when said block has a similar distance to said 
adjacent blocks whose group number is known, 
said block is grouped into the same group as 
said adjacent blocks and when said block has 
a similar distance to said adjacent blocks 
whose group number is unknown, said block is 
grouped into a group denoted by a new number. 

3. A vehicle monitoring apparatus as claimed In claim 
1 or claim 2. wherein 

sard distance image is divided into lattice-like 
divisions and said histogram is prepared for 
each of said divisk>ns. 

4. A vehicle monitoring apparatus as claimed in any 
of claims 1 to 3. further comprising: 

a group number memory for memorizing a 
number of said group to which said image data 
belongs and a group area memory for memo- 
rizing a number of said image data to which 
each of sakj groups belong as an area size. 

5. A vehicle comprising a vehicle monitoring appara- 
tus as claimed in any of the preceding claims. 
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